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FOREWORD 



This research represents a portion of the exploratory development program of 
the Technical Training Branch, Training Research Division of the Behavioral Sciences 
Laboratory. The research was documented under Project 1710, ''Training, Personnel 
^"^-euad Psychological Stress Aspects of Bioastronautlcs , "Task 171007 , "Automated 
Training and Programmed Instruction. " The research was conducted by the Univer- 
sity of Pittsburgh under Contract AF33(616)-7175. Dr. Robert Glaser w&s the prin- 
cipal Investigator. Air Force personnel associated with the research were changed 
several times during the effort. Dr. Gordon A. Eckstrand w|s the project scientist 
throughout essentially the entire period. Dr. Felix Kopstela was the Initial Air Force 
technical monitor. He was succeeded by Dr. Theodore E. ^tterman and Dr. Ross L. 
Morgan. Likewise, task scientists were Dr. Marty R. Rockway, Dr. Theodore E. 
Cdtterman, and Dr. Ross L. Morgan. The authors acknowledge the various contri- 
butions of the above Air Force personnel to the planning, execution, and reporting 
of the research. This research began in October 1951 and was completed In October 
1962. 

The present version of this report was prepared by Dr. John S. Abma, using 
material submitted to the Air Force by the cont^iactor. Special recognition Is due to 
the following Individuals for their contribution to the research. Dr. Halmuth H. 
Schaefer was largely responsible for the development and tryout of the original pro-^ 
grams. Mr. Theodore Harakas prepared the multltrack versions of the program and 
assisted in the editing of the linear version. Dr. John C. Knipp, Professor of Mathe- 
matics and Acting Chairman of the Mathematics Department of the University of' 
Pittsburgh, cooperated in carrying out the experiment. Dr. Felix Kopsteln, Mr. J. R. 
Anderson, and Mr. E. Dugan helped coordinate the administration of the program at 
Wright -Patterson Air Force Base, Procter and Gamble^ and Westlnghouse Electric 
Corporation, respectively. Thanks are offered to those who carried out the task of 
frame writing In the development of the original program, both linear and multltrack 
versions; John A. Barthen^ Donald Conine, Suzanne P. Berwlnd^ Richard Pike, 
Gordon Purucker, Abe Schwartzman, Louis Tamburlno, I. B. Turksen^ and Harry Zwlbel. 

This technical report has been reviewed and Is approved. 

-W. F..GRETHER, PhD 

Technical Director 

Behavioral Sciences Laboratory 
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ABSTRACT 



Two experiments were performed to evaluate multltr<acklng (branching) in a 
linear program. In exprSHmeni -one, the multltracking cx)nsisted ofiprovldlng addi- 
tional cues at each frame for use by thope students who felt unsure of their response. 
Results indicated no significant differer ce in efflclenc/ between tjie regular linear 
program and the multltrack program. In experiment two, the multltracking consisted 
of large frames followed by more^ detailed frames ^whenever the student made an error* 
Large frames were developed by combining an average of three small frames. Again, 
the results Indicated no difference In Instructional efficiency betwleen the regular 
linear program and the multltrack prograjn. Although more errors were made on tii^ — 
large-step branching program, performance on criterion tests was ^s good as for the 
Althpugh branching reems a reasonable way to 



regular small-step linear program, 
accommodate Individual differences^ th* 
not show an advantage. More promlsinc 
quent branches, at critical points in the 
by special remedial frames^. rather than 
large frame. 



two methods attempted in this research did 
methods of blanching mlgfit be (a) less fre* 
program, and (b) large-step frames followed 
3y mere repetition of p&rtsjof the original 
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SECTION I 
INTRODUCTION 

\ 

One of the advantages of programed instruction is the individualization of training. 
A trainee can go at his own rate with materials designed to teach the specific train^ee 
^group involved. Most linear programs have only one track or sequence of frames for 
all students to follow. Intrinsic programing, on the other hand, does provide branch^ 
ing whereby correct and incorrect responses are differentially treated^. Computer- 
based programs can assess an individual's progress and assign different sequences 
as required . By and large , studies have indicated that the -efficiency of branching 
and multitracking procedures have thus far provided little consistent advantage over 
linear sequences. Cdul§oii^and Silberman (ref 4) found that subjects with a very 
limited form of branching learned as well as and in a shorter time than' those taught^ 
without branching. Using a computer as a control unit in a followup study, Silberman 
and others (ref 9} found no significant difference between a branching and a fixed- 
sequence version of a logic program . Modification of the remedial Jtems and the ~ 
branching structure jof this program resulted in superior learning by the branching 
group (jref 3). Campbell (ref 2) compared a branching program with three linear pro- 
grams of different length and found.no significant difference ori. a post-test. In a 
comparison between a branching and a linear program, Mager (ref 7} -found superior 
performance on the^part of the lingar-group on a calibration task, but this group had 
taken more training time" (ref Sh 

i 

The two experiments reported here investigate some further techniques of multitracking 
in a linear program to assess any instructional efficiency that may be gained over a 
straight-line program. ^ ^ ^ ^ 



SECTION II 
EXPERIMENT 1 



Correct responding Is one of the major requirements of linear programs. Sphe program 
is constructed so that responses are always within the repertoire, or ability,, of the 
student. Each step prepares him to respond correctly to the succeeding steps. When 
the program falls to evoke correct responses, the learning efficiency may suffer. The 
erroneous answer may cause irouble ln.the learning of succeeding program steps. To 
eliminate as entirely as possible the occurrence of wrong answers, a multltrack pro- 
gram was devised which would pfoyide.^ddltibnal cues to students who were unsure 
of the correct__answer. . The stud6nt*could make use of as many of the cues provided as 
he needeti before responding. Since different students would call for different amounts 
of cueing, the program is an example of branching within a generally linear program. 

MATERIALS 

A lengthy program of 2^500 frames was devised for the experiment. The tifle of the 
linear program is "Mathematical Bases for Management Decision-Making: Matrices 
and Mathematical Programming. " ^ Titles ofthe twenty sections of the prbgram are; 

1 - Symbolic Notation 

2 - Transportation Problem in Matrix Form 

3 - Production Scheduling in Matrix Form 

4 - Basic Matrix Notions 

5 - Matrix Multiplication 
' 6 - Row Operations 

7 - The Inverse of a Matrix 

8 - Systems of Linear Equations 

9 - Industrial Applications of Systems of Linear Equations 

10 - Systems of Linear Inequalities 

11 - Optimum Solution by Graphical Method to Two-Dimensional Linear 

Inequality Problem 

12 - Linear Combination of Vectors, Linearly Dep^dent and Linearly 

Independent Vectors, and Vector Spaces 

13 - Bases and Convex Sets 

14 - Introduction to Linear Programming 

15 - Fundamental Matrix Concepts in Linear Programming 

16 " Simplex Method — Determining Pj^, the Vector to Enter the Basis/ 

and Pj., the Vector to be Removed from the Basis 

17 Simplex Method Transformation of Tableaus 

18 " Simplex Method — Solution of Example Problems 

19 - Mixed Systems of Restrictions, Alternate Optima, and Degeneracy 

20 -Transportation Problem in Simplex Form 



I. These materials have been revised and are now available from Encyclopaedia 
Britannica Press, Chicago^ 111. 
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The multttxack program first presents the student with an ordinary linear frame. He 
is instructed to answer only if he is sure that his response is the correct one. If 
he has any doubt, he can us'e another frame, found immediately below the frame he ' 
has just attempted. This frame covers the same inaterial^ but is move highly cued. * 
If the student is still unsure, he can choose yet another version of the frame which 
provided still more cueing. The last frame is very likely to supply the answer through 
very direct prompting, eg-^ a copy or echoic prompt. After getting the correct answer, 
the student returns to the ordinary version of the next frame — the version which 
supplies only the amount of cueing necessary for most students. This multitrack pro- 
gram was compared with a linear program covering the same subject matter. The 
linear program was made up of the first-level -of -difficulty frames used in the branch- 
ing program. ' / 



SUBJECTS 



Three separate groups of subjects participated in this experimer*' . Twelve subjects ' 
were from VWight-Patterson Air Force Base, Ohio; twelve more w^re from Westinghouse 
Electric Corporation, East Pittsburgh, Pa; and eight were from the Procter and Gamble 
Company, Cincinnati, Ohio, thus, a total of 32 subjects participated. Some of the 
si»bjects had college degrees, others did not. In general, they presented a wide va** 
riety of vocatipnal backgrounds and interests. 

PROCEDURE 

I 

The experimental procedures differed for the three groups participating in this research; 
therefor, procedures will be described separately for each group. 

WRIGHT-PATTERSON GROUP 



For sections 1 through 10, 7 of the subjects used the linear version and 5 of thejn used 
the multitrack version. Assignment of subjects to the two versions was made at' random. 
The linear format was used by all subjects on sections 11 through 20. 

The subjects were issued the program one section at a time. The programed instruc-* 
tional material was completed either at home, or if time permitted, during tlie course 
of their regular work assignments. tJpon completion of a section, the subject sub- 
mitted it to the coordinator who administered the criterion test at that time. The sue-* 
ceeding section was then issued to the subject. After all 20 sections were finished, 
the subject was given a final examination. The examination consisted of 21 con- 
structed -response items. 

PROCTER AND GAMBLE GROUP 

Five of the subjects were assigned the linear format for the entire course and three 
of the subjects were assigned the multitrack format for the entire 20 sections. Three 
of the degree subjects and two of the noncolleqe subjects worked on the linear version? * 
two of the degree subjects and one of the noncollege subjects worked on the multi-* 
track version. 



The programed materials were completed at home or at work If time permitted. One 
section at g time was distributed to each participant. When a section was finished* 
the subject returned It to the coordinator and the criterion test was taken at this time. 
-Then the next section was given to the subject to complete at his own pace. An exam- 
ination covering the first 10 sections was taken by each subject after having completed 
all 20 sections. The examination was a 20 item constructed-response examlhation. ^ 

WESTINGHOUSE ELECTRIC * . * * 

All subjects used both the linear and multltrack versions. A subject "would complete 
five sections using one format (linear or multltrack) and then use the other format for 
the next five sections. Thus^ery subject was exposed to both' linear and multltrack 
versions^ The assignment of the format type was made to Insure that each section 
had approximateTy the^ame proportion of college andlioncoUege educational back- 
grounds . 

Again, the programed instructional materials were studied at home or at work, if time 
permitted. As was the case with both the Air Force and Procter and Gamble subjects , 
one section at a time was given to each subject. Hov^ever , only aTS^JOt hdlf of the 
'criterion tests were given immediately after having completed a section of the program- 
ed materials; the other half of the criterion tests were delayed 3 to 4 weeks after a sec- 
tion was completed. An examination covering the material in the first 10 sections was 
given to those subjects who completed the entire 20 sections. This is the same exam^* 
Ination as that taken by Procter and Gamble participants . 

RESULTS 

f 

Criterion test scores , error data and time information for all three subject groups 
were analyzed. Since the results from the three groups correspond closely, ^he com- 
bined results for all groups are reported here. Table I shows the percent correct on a 
criteripn test designed especially for the program. Table II shows error rate during 
use of the program. The results are shown separately for college and noncoUege sub- 
jects, since they differed so widely in their performances. 

TABLE I 



CRITERION TEST SCDrES 





Linear 


Multltrack 


College 
NoncoUege 


89.13% 
75.40% 


86.92^ 
71.609fe 
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TABLE n 



ERROR RATES 

1 

/* 







Linear 


' Multitrack 




College 


0.029 


0.036 




Honcollege 


0.044 


0.052 











Table III shows learning time in minutes per frame. It compares the college grdUp 
learning time with the noncoUege jgroup learning time for the subjects who used the 
* linear program , and for those who used the multitrack program (Air Force subjects 
werd not incliKied since these times wefe not available for this. group). 

The data are based on the time the subjects used completing the equivalent of a 
frame in the regular linear program, ie, students requiring additional cueing in the 
anching program were not credited with completing additional franves- ^ 

■\ , 

TABLE in . . ' 

r 

TIME IN MINUTES PER FRAME 





Linear 


, Multitrack^ 


College 
Non college 


0.p7 

1.08-^ 


"-"''^.04 



In all three comparisons (criterion test score, error rate, learning tiftie)^ (i) the 
college group was superioj^to^he-noncollege group, (2) the college group on linear 
was superior to the coUegegroUp on multitrack* and (3) the noncolleye group on 
linear was superior to the noncollege group on multitrack. StatisTical tests were 
not performed on these data. The results are the combined findings from separate 
replications using different types and numbers of subjects. The results, although 
tentative, give no indication that the branching (multitrack) procedure tri^fhere 
offers any advantage over the more usual linear program. 



i 



TABLE IV 
RETENTION TEST SCORES (%) 





Immediate 
Testing 


4-week Delayed 
J Testing 


. Linear 
Multitrack 


80.88 
76.99 


■ ' 81.34 
82.87 



Table IV shows retention data for the Westinghouse Electric^ Got poratl on subjects. 
(Similar data were not available from the other groups)'. Statistical tests were not 
performed because of a low N for each celljtS^ 5 subjects^. These tentative data 
suggest more reminiscence for the Jiultlfrack program, but the immediate testing 
might have been unreliablejiue^o^ procedural of other factors* The final scores 
delayed testlng^uggest^good retention tor bbth the linear and multltrack versions. 

CQNX3L0SIONS 

The data obtained in the program tryouts on the various groups was adequate for 
program evaluation. The data also permitted a comparison of a straight-line program 
and one form of multitrack program. Under the conditions of this experiment, no 
advantage could be shown for the multltrack ^ogram over a regular linear program. 
Records of subject responses indicated that'^'few branchei; were taken in the multi- 
track program. Students may have been reluctantJto admit they needed additional 
cues. However, the firs t-'level-of -difficulty frames were^lready so highly cued 
(easy) that subjects simply did not need the branching option for the vast majority 
of frames. As shown in table 2, error rates were very low for both versions of the 
program. Both versions of tRe programs were identical to the -extent that the avail- 
able branches were not used. 



Additional data obtained in the course of the experiment provided Information for 
tenEat^jfi conclusions about the relation L.tween subject characteristics and program 
performance. The performance of the subjects who had college mathematics was 
superior to those who had no college mathematics. The noncollege groups did not ' 
consist of recent high schdol graduates; they had "ery little mathematical background 
other than bsfslc arithmetic. The performance of subjects who had recently completed 
their courses in high school mathematics as it is now taught probably -would be better. 
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SECTION in 
mERIMENT 2 



The multitrack program used in experiment 1 was based on a linear program having 
a Ijow error rate. The branching feature was designed to eliminate even those few 
errors that might be made on the linear version by providing additional cues and 
prompts when the student was not sure of the correct response. The branching fea- 
ture did not lead to higher attainment levels under these conditions. In order to 
force more subjects to use extra tracks or branches-, a. more difficult version was 
prepared. For this purpose/ frame difficulty was increased by combining several 
frames from the linear program. Students who found a large combined step too dif" 
ficult could branch to the series of small linear pcpgram steps dealing with the 
same content. 

MATERIALS * 



rlt ni 



The first nine Sections of the .Management Decision Making Program (1060 frames) 
were used (seej page 2). These sections teach Matrix Theor/i Summation Symbolism, 
and the Industrial Application of Malrix Theory* When the sections are combined, 
they represent a self-contained unit of study. 

For the construction of the mUltitrack experimental^version, frame sequences consist- 
ing of an average of 3.2 of the original small .step linear frames were grouped, on the 
basis of subject matter content^ into one large,frame which usually required only one 
response. The entire program was reconstructed in this manner. Figure 1 shows an 
example of a frame sequence in the linear program, and Figure 2 shows the same set 
of frames combined into one large frame. Ajstudent using'the original linear program 
would respond three times to three different frames and receive confirmation each 
time. A student taking the new large-step program, however, would read one long 
frame, then jpa)^ a single response and receive confirmation only once. All frames 
in the nine sections were reconstructed in this manner. At times it was necessary 
to insert transitional phrases, but usually the exact ^wording of the linear small-step 
frames was satisfactory. 

\ The branching aspefet of the large-step experimental version consisted of shifting ' 
individuals who responded incorrectly to large-step frames back to the original se- 
quence of small steps from which the large frames were constructed. The original 
small steps were printed on the reverse of each page containing the corresponding 
large step. The student could refer to the back of the page when he responded in- 
correctly. In comparison with the small-step linear program, this multitrack pro- 
gram involved less overt responding and ccJiSirmation (333 frames, requiring approxi- 
mately 1/3 the number of responses) , plus the possibility of branching to smaller 
steps. The programs covered the same material. 

/ ■ ' ' : 
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149. The coefficients In an expansion may 
often be expressed as an Index. 



X + 2x„ + 3x„ + 4x = T< 
1 2 3 4 ^ 

J =1 

y ^ + 2y ^ + 3y^ + 4y^ + 5y^ = 



20 

E jy 

j=2 \ 



J 



150. 6x_+ 7x + 8x + 9j^-, = B Jx. . 
6 7 8 9 j=6 



2y2 + 3yj + ... + 19y^g + 20y^^ = 



4 

E 2jy 



J 



151. If all our terms have coefficients twice the Index 
of the summand, we may use 2j as the coefficient 
Index. Then 2x^ + 4x^ + 

\ 5 

6X3 + 8x^ + lOXg = ^E 2j;cj . 2y^ + 4y2 + 



Figure 1 . Three Frames From The Straight Linear Program 
(Control Program) • 
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149-151 The coefficients in an expansion may otten 
be expressed as an index. Consider theyf 
following examples: 

^ 4 ■ 
x^.-^^>2x2 ^ ^ 4x- = ^^S Jxj 

5 



=7 J ■ ^ 6xg + 7xy + 8xg + 9x^ = JD jx. 



20 



2y + 3y + ... + 19y ^ + 20y = ,S jy 
2 3 19 20 j=2 j 



( 



If all our terms have coefficients twice the 
index of the summand^ we may use 2j as the 
coefficient index. 

Thus g 

2x^ + 4x^ + 6x^ + 8x, + lOx = S 2Jx 
I Z 3 4 5 j_,jj 

2x, + 4x« + 6x^ + 8x, = . 



[Note: The small-step branching sequence was available to the! 
student on the back of the page. J 



Figure 2. A Large-Step .Combining the Frames irt Figure 1, 
(Experirndntal Program) 
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Subjects were high school teachers attending a National Science Foundation Summer 
Institute for Mathematics Teachers. Of the 35 students in the class, 34 were sei 
lected and matched into 17 two-person blocks. The subjects were matched on the\ 
basis of five variables: (1) age; (2) number of years since last math course; (3) num- 
ber of credits in past math courses; (4) cumulative grade average for math courses; * 
(5) performance-oi;fe^a 15 item pretest of basic matrix operations selected from the post- 
program criterion test. During'the study* three blocks were dropped — two because 
of individual dropouts , and one because of a seriously inadequate background . 

PROCEDURE ' ' ' 1 ■ ^ I 

The program was administered three times weekly for 2 weeks at regular intervals. 
Class sessions were scheduled for periods of M/2, W/2^ and 1 hours, respectively. 
Duriiiig the last week of the study, a "catch up" session of 1 1/4 hours was scheduled 
^pr 17 of the students. In addition, 17 students worked from periods of M/2 - 4*1/4 hours 
at home. These students kept individual records of their working time at home. The 
programs were collected at the end of each class session and the subjects were in- 
structed not to study any related material. 

During the scheduled sessions, the control group worked with the small-step linear , 
program. The experimental group used the large-step program, after receiving detailed 
instructions on how to use a branch whenever they responded incorrectly to a large- ' 
step frame. The subjects took a 63-item criterion test following completion of the 
program. The test Items were multiple -choice questions witli five alternatives* 

RESULTS ' I 

The performance of experimental and control groups was compared on the criterion 
test. Time in hours to complete the program was also examined. See Table V. 

Criterion Performance 

A t^ test for matched gi'O'Qps fflrowHtTrrcrstgnificant difference between the criterion 
test performances of the experimental and control groups (t = 0.35# P > .05). The 
combined score for the linear group was 44.3 apd for the multitrack group was 43.2. 
The total possible score was 63, hence average proficiency v/^s 69.4% of a perfect 
criterion performance. ' 

Performance Time y ^ 

The average time taken to Complete the program was 10.6 hours for the control group 
and 11.1 hours for the expe^rimental group. The difference l^etween these group means 
was not* sign if leant (t = 0.94# p >.05). The average number of frames per tour was 
101.7 small-step frames for the control group and 30.3 large^step irameg for the 
experimental group. 
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TABLE V 

TEST RESULTS AND TIME SCORES 



_ Pair 


Criterion Test 


Time (hr.) 


Frames 


Der hour ' 


Error Rate 




Exp. 


Control 


Exp. 


Control . 


Exp. 


Control 


Exp. Control 


A 
n 


41 


32 


12.2 


10.0 


27.3 ^ 


106.0 


13.2% 3.6% 


D 


51 


47 


10.7 


■9.5 


31.1 


111.6 


8.1% 3.4% 




42 


35- 


13.3 


9.7 


25.0 


109.3 


6.0% 6.6%' 


r\ 
U 


57 ' 


49 


10.2 


14.4 


32.6 


73.6 


6.0% ■ 1.7% 


^( 


25 . 


53, 


10.0 


10. ^ 


33.0 


103.9 


12.6% 6.7% 


F 


44 


■32 


12.1 


10.0 . 


27.5 


106.0 . 


6.3% 18.2% 


G 


58 


55 , 


9.7 


10.1 


34.3, 


105.0 


^10.5% 1.6% 


£1 


46 


57 


9.7 


8.9 


34.3 


119.1 - 


3.6% 1.1% 


I 


36 


48 


11.5 


11.9' 


.29.0 ■ 


89.1 


19.8% 6.4% 


!■ , 


32 ■ 


40 


10.7 


12.2 


31.1 


86.9. 


12.9% 1.9% 


K 


44 


31 


11.9 


12.4 


28 00 


85 5 ' 


3 '3% 2 4% 


L 


46 


52 


9.1 


9.0 


36.6 


117.8 


2.7% 


M 


52 


54 


11.5 


8.8 


28.0 


120.5 


6.0% 2.7% 


N 


31 


• 35 


12.7 


11.9 


26.2 


89.1 


12.6% 2.6% 




505 


620 


155.3 


149.0 


424.0 


1423.5 




X 


43.2 


44.3 


11.1 


10.6 


30.3 


101.7 


8.9% 4.3% 




10.3 


9.3 


1.4 


1.6 


3.4 


13.9 
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Program Characteristics 

Table VI shows the average error rate for each of the nine sections of the experi- 
mental program and the total error rate for the program. Error rate was compuHed by 
dividingvthe total number of errors by the total nomber of possible correct answers. 
For example, the total number of errors made by the 14 subjects on section 1 was 
130? the total possible number of correct answers is the number of frames (60 frames 
in section 1) multiplied by the number of subjects, or 952. Thus the error rate for 
section 1 was x 100 = 13.7%. Table VII shows the error rate for each of the 

nine sections for the small-step single-track program. The error rate for each subject 
is shown In, the last two columns of Table.V. The difference between error rates for 
the two programs is statistically significant. 

. The use made of the branching feature in the experimental program was analyzed. 
Subjects used a branch only 37.6% of the time that they made errors on the program. 
Interrogation of the subjects- indicated that when ^ branch was not used, it was. In 
general, obvious to them what their error was. Subjects reported that they generally 
used the^Jjranch only when they did not understand why a response was incorrect after 
receiving confirmation . ' ^ 

^ TABLE VI 

ERROR RATE FOR THE MULTITRACK PROGRAM (N = 14) 



Section 


1 


2 


3 


4 


5 


6 


7 


8 


9 


Total 


No. Frames 


68 


26 


20 


40 


70 


26 


45 


22 


16 


333 


Total No. Errors 






















for All Subjects 


130 


46 


32 


14 


6S 


42 


43 


, 26 


19 


417 


Error Rate 


13.7% 


12.6% 


11.4 


2.5% 


6.6% 


11.5% 


6.?% 


8.4% 


8.5% 


8.9% 



/ 



12 



16 



TABLE VII 

ERROR RATE FOR THE SINGLE-TRACK PROGRAM (N = 14) 



Section 


1 


2 


3 


4 


5 


6 


7 


8 


9 


Total 


No. Frames 
in Section 


282 


82 


68 . 


lU 


215 


73 


112 


62 


55 


1060 


Total Number 
Errors 


194 


70 


63 


38 


135 


51 


45 


32 


96 . 


654 


Error Rate 


4.9% 


6.1% 


6.6% 


2.4% 


4.5% 


5.0% 


2.9% 


3.7% 


3.49^ 


4.3% 



CONCLUSIONS AND IMPLICATIONS 

The results of this study are clear. When the small steps of an effective linear 
program were combined into larger steps with provision for branching to smaller 
steps, there was no change in irtStructional effectiveness. Criterion test scores 
and time to go through the program were the same for the two programs . Subjects 
went through the small-step program at a rate of about 100 frames per hour? for 
the large-step program, in which the frames were on the average three times as 
long as the small-step frames, the subjects went one-third as fast or about 30 
frames an hour. However, frame error rate was significantly diff^ent for the two 
groups, fewer errors being made in the small-step, single-track program. 

The two main differences between the programs were size of step and the branching 
possibility. With respect to $ize of step, three previous studies comparing small- 
step and large-step programs "... have demonstrated superior^leamihg with the 
small-step program, but only at the expense of added training time {ref S#4,2). 
Smith and Moore {ref 10) . . . found no differ3nces in learning with different step 
sizes." (ref 8,p 182). The size of step is not a uniformly defined variable, and 
its definition must be carefully examined in the context in which it is used (ref 6). 
In th$ present study it is defined as the combination of small steps'from an existing 
linear program. More reading and less overt responding was thus required, and 
confirmation was received less often. 

In the present study a direct test of the size of step variable was not possible be- 
cause the large-step program offered opportunity for branching. Errors were made 
on the multitrack program at a rate of 8.9%. However, branches were actually 
taken after only about one-third of these errors. Thus, branches were taken at a 
rate of 3.34%. For the most part, then, the multitrack program was used as a large- 
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step program. Consequently, the results obtained suggest that size of step is not 
as sensitive a variable as previously considered in its influence upon maximizing 
reinforcement and minimizing error. 

In general^ branching might serve two functions: (1) adjust or tune the instructional 
characteristics of the program to the individual learner and (2) provide correction of 
incorrect responses. With respect ta adjusting program characteristics to the indi^ 
vidual learner, much more needs to be determined about the dimensions involved in 
individual differences in ij^aming. Just what are the properties that make a differ- 
ence: size of step, learning rate, number of reinforcements ? With respect to cor- 
rection of errors, little seems to be known about its effect on learning. Most basic 
learning studies have emphasized the contingencies involved in reinforcement and 
extinction trials. Some recent verbal learning studies have considered the effects 
of infprmation through announcement of "right" or **w^ong** following a response 
<ref 1). Much less concern has been evidenced in studies where an incorrect re- 
spo^ise iS'iollowed by a correction. 

Average criterion test performance for both groups was approximately 70% of perfect 
score. This is in contrast to the group in the first experiment where criterion per- 
formance for college-trained subjects was about 89% for the small -step program. 
When a heterogeneous group of subjects used this program, they did not acheive 
equal performance on the criterion test. The specification of prerequisite knowledge 
prior to program instruction is a significant predictor of success in learning from 
the program. It should be taken into account in both the experimental and operation- 
al use of program instructional sequences. 
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